Can CNNs Construct Highly Accurate Model Efficiently with Limited Training Samples?
نویسندگان
چکیده
It is well known that metamodel or surrogate modeling techniques have been widely applied in engineering problems due to their higher efficiency. However, with the increase of the linearity and dimensions, it is difficult for the present popular metamodeling techniques to construct reliable metamodel and apply to more and more complicated high dimensional problems. Recently, neural networks (NNs), especially deep neural networks (DNNs) have been widely recognized as feasible and effective tools for multidiscipline. Actually, some popular NNs, such as back propagation neural networks (BPNNs) can be regarded as a kind of metamodeling techniques. However, for high dimensional problems, it seems difficult for a BPNN to construct a metamodel. In this study, to construct the high accurate metamodel efficiently, another powerful NN, convolutional neural networks (CNNs) are introduced to construct metamodels. Considering the distinctive characteristic of the CNNs, the CNNs are considered to be a potential modeling tool to handle highly nonlinear and dimensional problems with the limited training samples.
منابع مشابه
Deepcast: Universal Time-series Forecaster
Reliable and accurate time-series forecasting is critical in many fields including energy, finance, and manufacturing. Many time-series tasks, however, suffer from a limited amount of training data (i.e., the cold start problem) resulting in poor forecasting performance. Recently, convolutional neural networks (CNNs) have shown outstanding image classification performance even on tasks with sma...
متن کاملGenerative Modeling of Convolutional Neural Networks
The convolutional neural networks (CNNs) have proven to be a powerful tool for discriminative learning. Recently researchers have also started to show interest in the generative aspects of CNNs in order to gain a deeper understanding of what they have learned and how to further improve them. This paper investigates generative modeling of CNNs. The main contributions include: (1) We construct a ...
متن کاملRegressing Heatmaps for Multiple Landmark Localization Using CNNs
We explore the applicability of deep convolutional neural networks (CNNs) for multiple landmark localization in medical image data. Exploiting the idea of regressing heatmaps for individual landmark locations, we investigate several fully convolutional 2D and 3D CNN architectures by training them in an end-to-end manner. We further propose a novel SpatialConfiguration-Net architecture that effe...
متن کاملDeep Pyramid Convolutional Neural Networks for Text Categorization
This paper proposes a low-complexity word-level deep convolutional neural network (CNN) architecture for text categorization that can efficiently represent longrange associations in text. In the literature, several deep and complex neural networks have been proposed for this task, assuming availability of relatively large amounts of training data. However, the associated computational complexit...
متن کاملIterative Learning with Open-set Noisy Labels
Large-scale datasets possessing clean label annotations are crucial for training Convolutional Neural Networks (CNNs). However, labeling large-scale data can be very costly and error-prone, and even high-quality datasets are likely to contain noisy (incorrect) labels. Existing works usually employ a closed-set assumption, whereby the samples associated with noisy labels possess a true class con...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1712.01639 شماره
صفحات -
تاریخ انتشار 2017